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(54) Parallel output architectures for CMOS active pixel sensors 

(57) An active pixel sensor formed by creating an X- 
Y array of pixels on a semiconductor substrate. The two 
dimensional array of pixels is arranged in a plurality of 
rows and columns that are addressed by addressing cir- 
cuits formed on the substrate. The active pixel sensor is 
functionally divided to enable the addressing and read- 
ing out of a plurality of pixels simultaneously by provid- 
ing areas, each of the areas having a row addressing 
circuit and a column addressing circuit. A signal 
processing circuit is provided for each area to output a 
sequential series of pixels in each of the are^s. A corre- 
lated double sampling circuit is provided 
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Description 

FIELD OF THE INVENTION 

[0001] This invention relates generally to solid state 
imager sensors having multiple output channels, and 
more particularly to architectures based on CMOS 
active pixel sensors (APS) having multiple output chan- 
nels that are designed for image capture requiring high 
frame and pixel rates. It is also applicable to systems 
where it is desirable to have separate output channels 
for each of the color defined by a mosaic Color Filter 
Array (CFA). The architecture is also suitable to other 
types of x-y addressable imaging array. 

BACKGROUND OF THE INVENTION 

[0002] The prior art has taught image sensors that 
have requirements to output data at a high pixel data 
rate. Typically, these high pixel rate requirements are 
achieved by employing a two-dimensional array (an x-y 
array) of pixels arranged into two split fields such that 
the output of one half of the pixels are sent to signal 
processing circuits located at an edge of the array adja- 
cent to that halt The other half the pixels are output to 
similar circuits located adjacent to that half. Technolo- 
gies that can be used to implement such arrays in the 
prior art have been CMOS APS or CCD. Other prior art 
teachings have disclosed two<Jimensional arrays that 
are formed into many blocks that each having their own 
output paths. These multiple output path prior art 
devices have increased the output data rate for image 
sensor arrays, however, they are limited in the amount 
and types of versatility that they provide. 
[0003] In a conventional CMOS APS, only a single row 
of the pixel array is addressed and the image data from 
that row is transferred in parallel to column circuits for 
signal processing such as offset removal. Each pixel in 
a selected row is read out in sequence to form one line 
of output image data. The total number of pixels in the 
array and the frame rate determine the pixel output rate. 
For high frame-rate devices or devices having a large 
pixel count for image capture, the data rate becomes 
excessive and the output channel electronics is no 
longer fast enough to capture and deliver the signal with 
high fidelity to the image digitization and store unit. For 
example, a 1000 x 1000 (megapixel) array running at 30 
frames/second has a pixel output rate of over 30 MHz. 
However, a 500 x 500 pixel array running at 1000 
frames/sec requires in excess of 250 MHz output data 
rate. Typical state-of-the-an pixel data channels (both 
the analog signal and the digitization circuits) are only 
capable pixel transfer rates in the of 10*s of MHz range, 
and therefore multiple parallel output channels are nec- 
essary to achieve high pixel output rate for high frame 
rate and high pixels count sensors. 
[0004] From the foregoing discussion, it should be 
apparent that there remains a need within the art for a 



more versatile multiple array for achieving high pixel rate 
data transfers . 

SUMMARY OF THE INVENTION 

5 

[0005] The present invention addresses the foregoing 
problems in the prior art by providing a CMOS based 
architecture for active pixel sensors (APS). A semicon- 
ductor substrate having a two dimensional array of pix- 

10 els arranged in a plurality of rows and columns is 
provided with a row addressing circuit formed on the 
substrate, a column addressing circuit formed on the 
substrate, a plurality of signal processing circuits opera- 
tively connected to the array of pixels such that each of 

is the signal processing circuits is electrically connected to 
a predetermined subset of pixels within the array 
through electrically conductive signal busses, wherein 
each of the subsets comprises a plurality of pixels, and 
means for employing the row addressing circuit and the 

20 column addressing circuit to select a sequence of pixels 
having one pixel for each of the subsets and simultane- 
ously transferring signals from each of the pixel 
sequences to the signal processing circuits. 

25 ADVANTAGEOUS EFFECT OF THE INVENTION 

[0006] The present invention in providing a CMOS 
based architecture that is fully compatible with the APS 
characteristics yields numerous advantages: it provides 

30 x-y addressability; sub-windowing and sub-sampling of 
the pixel array (to provide for example a higher frame 
rate with fewer pixels per frame); for color image sen- 
sors having mosaic Color Filter Arrays it provides a par- 
allel channel connection scheme can be used to 

35 preserve the CFA pattern during sub-sampling; and for 
CFA-based color image sensors, each of the parallel 
channels can be used for a single color to simplify color 
signal processing (such as color-specific gain setting 
and digitization). 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0007] 

45 Fig. 1 is a block diagram of a prior art device having 
two output circuits; 

Fig. 2a is a block diagram of an embodiment of the 
present invention having four output channels; 
Fig. 2b is a block diagram of an embodiment of the 

so present invention having four output channels; 

Fig. 2c is a block diagram of an embodiment of the 
present invention having four output channels; 
Fig. 2d is a block diagram of an embodiment of the 
present invention having four output channels 

55 where the four pixels simultaneously output on the 
channels are arranged in a mosaic pattern; 
Fig. 2e is a block diagram of an embodiment of the 
column addressing signal processing circuits of the 
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present invention; 

Fig. 3a is a block diagram of an embodiment of the 
present invention having eight output channels; 
Fig. 3b is a block diagram of an embodiment of the 
present invention having eight output channels; 
Fig. 4 is a block diagram illustrating the basic func- 
tional blocks in the output channels; 
Fig. 5 is a schematic diagram of each of the output 
channels in the preferred embodiment as envi- 
sioned by the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[0008] Fig. 1, which is a block diagram of a prior art 
sensor device wherein the sensor 100 is arranged such 
that there are two individual photosensing fields 119, 
129. The sensor 100 illustrated is a charge coupled 
device (CCD). Fields 101, 102 each have a horizontal 
shift register 105, 106 that provides an output path for 
each of the field 101, 102. The sensor if effectively oper- 
ated as two individual sensors, thereby doubling the 
pixel data transfer rate of sensors having only a single 
field or frame. To further increase pixel data transfer 
rates, prior art sensors have provided field 101 with out- 
put taps 121-127 that operate in conjunction with output 
120 to remove charges that are currently being trans- 
ferred through horizontal shift register 105. In a similar 
manner field 102 has output taps 131-137 that operate 
in conjunction with output 130 to remove charges that 
are currently being transferred through horizontal shift 
register 106. This yields a total of 8 outputs (130-137). 
The large number of outputs greatly increases the pixel 
data transfer rate which is essential for certain systems 
having high speed requirements. However, no random 
addressing capability is provided by such 
[0009] The present invention envisions that by con- 
necting multiple (two or more) rows or multiple pixels to 
signal processing circuits in parallel using signal 
busses, multiple output circuits, or channels, can be 
used to lower per channel data rate requirements (Fig- 
ures 2a through 2d) for devices that have high date rate 
requirements overall. This multiple channel implemen- 
tation is also applicable to color x-y addressable sen- 
sors where it is desirable to have separate output 
channels for each different color. As an example of sep- 
arate output channels for each different color is that 
each of pixels 1,2,3 and 4 (in Figures 2a through 2d) 
are each configured to sense a different color (such as 
Bayer pattern having 2 green, 1 red and 1 blue chan- 
nels). The column-wise output signal routing connects 
all the pixels of the same color filter covering to a color 
specific output channel. 

[0010] Referring to Fig. 2a, which is a block diagram 
of the present invention having a pixel array 10 with four 
output channels out 1, out 2 out 3 and out 4, the 
selected pixels 1, 2, 3, and 4 are output simultaneously 
via four discrete signal processing circuits 11, 12. 13, 
and 14. As shown in this embodiment the four selected 



4 

pixels 1, 2, 3 and 4 are selected from a single row that 
is selected by row address circuit 18 for output. Four 
parallel channels are thus implemented where 4 pixels 
from a selected row are addressed and read out to 4 dif - 

5 ferent circuit blocks. Row addressing circuits 1 8 are pro- 
vided on chip as envisioned by the present invention. 
Column addressing circuits are provided on chip also, 
but as envisioned by the present invention, are part of 
the signal processing circuits 11, 12, 13 and 14. The 

10 row and column addressing circuits, are conventional 
circuits that are well known within the art of image sen- 
sors. The signal processing circuits 11,12, 13 and 14 as 
well as the output circuits out 1 , out 2 out 3 and out 4 
(which will be discussed in more detail below) are 

is essentially identical circuits that are repeated for each 
of the four channels with variation only for purposes of 
color. The present invention as envisioned by Fig. 2a 
will have each channel handle one quarter of the pixels 
with four pixels being simultaneously processed, one by 

20 each channel. 

[001 1] Fig. 2b is a block diagram of another embodi- 
ment of the present invention having four output chan- 
nels that is a variation of the embodiment discussed in 
Fig. 2a. Referring to Fig. 2b, pixel array 20 with four out- 

25 put channels out 1 , out 2 out 3 and out 4, simultane- 
ously output the selected pixels 1, 2, 3, and 4 via four 
discrete, signal processing circuits 21, 22, 23, and 24. 
Here, two consecutive rows are required to select the 
four pixels that are being processed simultaneously by 

30 four different circuit blocks. The pixels as presented in 
the embodiment shown in Fig. 2b are, typically, part of a 
mosaic color filter array (CFA) pattern that are typically 
used within the prior art. As shown the four pixels that 
are processed in parallel are associated based on color, 

35 with two green pixels (indicated by G), one blue pixel 
(indicated by B) and one red pixel (indicated by R) four 
each group of four that are simultaneously processed. 
[0012] Fig. 2c is a block diagram of another embodi- 
ment of the present invention having four output chan- 

40 nels that is a variation of the previous embodiments that 
have been discussed. Pixel array 30 has four output 
channels out 1, out 2 out 3 and out 4, with the selected 
pixels 1,2,3, and 4 being output simultaneously via four 
discrete signal processing circuits 31, 32, 33, and 34. 

45 Fig. 2c is a block diagram illustrating a 4 channel varia- 
tion where the signal processing circuits 31 , 32, 33 and 
34 are located on only one side of the imaging x-y array. 
The selected pixels 1 , 2, 3 and 4 illustrated here are on 
consecutive rows, though not necessarily adjacent pix- 

50 els preventing the formation a mosaic pattern. This is for 
illustrative purposes to show that a variety of schemes 
can be used in placement of the circuitry associated 
with the pixels selected for output. 
[0013] Fig. 2d details the connection matrix of the 

55 selected pixels 1. 2, 3 and 4 to the color-specific chan- 
nels within sensor 20 for the embodiment shown in Fig. 
2b illustrating the column signal busses used to connect 
various pixels to output channels. As seen in Fig. 2d, 
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each column has at least two signal busses connecting 
half the pixels in that column to pixels in accordance 
with the channel that those pixels are associated with. 
Thus, half the columns have signal bus lines interfacing 
pixel types 1 and 3 with respective signal processing cir- 
cuits 21, 23 and the other half have signal buss lines 
interfacing pixel types 2 and 4 with respective signal 
processing circuits 22, 24. 

[0014] Fig. 2e details a block diagram for interfacing 
column signal buss lines, with signal processing and col- 
umn addressing circuits. Pixel data arrives from the 
pixel column bus into a CDS circuit 91 where double 
sampling takes place. A column select signal is applied 
to switches 95. 96 to alternately supply difference ampli- 
fier 92 with the reset sample and signal sample to pro- 
vide an adjusted output for each of the columns that are 
currently selected by the column address circuit. 
Switches 95, 96 are transistor configurations that can 
any of CMOS, PMOS or NMOS circuits, depending 
upon the design criteria that is employed by a given 
process. The difference amplifier 92 may have its gain 
value be a fixe value, or the gain value can be program- 
mable. A programmable gain value can be provided 
either at the metal or at the logic level. 
[001 5] Another architecture is to divide the array into 
quadrants and then apply the same multiple-pixel con- 
nection architecture previously discussed to achieve 
even higher number of parallel channels. Fig. 3a is a 
block diagram of an embodiment of the present inven- 
tion wherein the array is divided into four x-y array quad- 
rants 41, 42, 43 and 44 that each have two output 
channels resulting in eight total output channels, with 
each output channel having its own column- 
address/signal processing output (51-58). The four x-y 
array quadrants 41 , 42, 43 and 44 also each have their 
own individual row address circuits 81, 82, 83 and 84. 
The invention disclosed here allows the construction of 
parallel channels to enable either high frame rate or 
high pixel count image sensors. An 8-channel imple- 
mentation of a 512 x 512 array of pixels is capable of 
transferring 1000 frames/sec resulting in channel data 
rate on the order of 35 MHz rate (depending on the 
overhead time involved in addressing, output setup time 
etc.) which is quite reasonable for incorporating per-col- 
umn correlated double sampling (CDS) or per channel 
analog-to<Jigital conversion in each channel. Using the 
quadrant architecture (as see in Fig. 3a) and double row 
output, the loss of pixel fill factor due to the addition of 
column signal busses (two per column) is minimal. A 
16-channel imager can also be constructed by using 
four column signal busses to output the pixel signals to 
four parallel addressing/signal -processing/output circuit 
blocks attached to each imager quadrant. 
[001 6] Fig. 3b is a block diagram of an embodiment of 
the sensor having four x-y array quadrants 41, 42, 43 
and 44 of present invention having eight output chan- 
nels as shown in Fig. 3a however, in Fig. 3b the eight 
output channels are configured to have color specific 
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output channels. The preferred method of arranging 
output channels in a color specific manner is to employ 
row addressing techniques that sequences the reading 
out of adjacent color pixels simultaneously to different 
5 channels. The preferred process for design layout of the 
four x-y array quadrants 41, 42, 43 and 44 and their 
respective addressing and signal processing circuits 
shown in Figures 3a and 3b, is to form one of the four 
arrays with its respective addressing and signal 
w processing circuits. The array is then mirrored a first 
time to create two quadrants with their associate 
addressing and signal processing circuits. The two 
quadrant mirrored design is then mirrored again to cre- 
ate the four quadrants 41 , 42, 43 and 44. It should also 
is be appreciated that the layout can design all four quad- 
rants individually, and that such a layout will have some- 
what different addressing characteristics that may 
simplify the signal processing. However, the preferred 
embodiment envisions that the simplicity of the mirrored 
20 design technique makes any additional signal process- 
ing to join the four quadrants worthwhile. 
[0017] Fig. 4 is a block diagram illustrating the basic 
functional blocks used in the output channels. The out- 
put channels are essentially identical to one another, or 
25 at least very similar. Correlated double sampling (CDS) 
91 is be provided for each of the output channels previ- 
ously discussed to provide the voltage level signal for 
each pixel. The preferred embodiment employs a differ- 
ence amplifier with each of the correlated double sam- 
30 pling units 91 which in turn outputs an adjusted voltage 
to a programmable gain amplifier (PGA) 93 from each of 
the channels. The PGA 93 will provide a predetermined 
amount of gain for each of the channels which is typi- 
cally based on color but can also be based on other fac- 
35 tors. 

[0018] Fig. 5 is a schematic diagram that generally 
applies to each of the output channels in the preferred 
embodiment as envisioned by the present invention. 
The CDS receives two samples (Reset and Signal) for 

40 each pixel, and accordingly provides two sample and 
hold circuits 101, 102, one for each the Reset and the 
Signal samples received from the associated pixel. 
Each the Reset and the Signal samples are stored on 
their associated capacitor C s , C R within the CDS 91 

45 when their respective switches S, R are closed. The val- 
ues stored on capacitors C s and C R are applied to the 
input of difference amplifier 95. These stored Signal and 
Reset samples are used as inputs to a difference ampli- 
fier. The difference amplifier outputs to a PGA which, in 

so the preferred embodiment is a variable resistor on the 
difference amplifier output. It should be understood, that 
the PGA can excepts the output of the CDS and have a 
differential amplifier placed after the PGA, however the 
preferred embodiment places the differential amplifier 

55 immediately after the CDS. It should also be understood 
that the PGA can use as a variable gain element a tran- 
sistor, a DAC or the like as well as a variable resistor. 
The CDS is reset by a transistor circuit that clears both 
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the Signal and the Reset capacitors. In the preferred 
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signal processing circuit 


embodiment PMOS transistors are used to clear the 
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signal processing circuit 


[001 9] Other aspects of the invention include: the sen- 
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signal processing circuit 


sor wherein each column is associated wit a two sub- 
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signal processing circuit 


sets; the sensor wherein each column is associated 
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signal processing circuit 


with a plurality of the subsets and further comprising 
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signal processing circuit 


customization means for altering the association 
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signal processing circuit 


between pixels and subsets; the active pixel sensor fur- 
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signal processing circuit 


ther comprising a correlated double sampling circuit for 




81 


row addressing circuit 


each subset within the sensor; the active pixel sensor 
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82 


row addressing circuit 


wherein the pixels in the array, further comprises a 
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row addressing circuit 


pinned photodiode within each of the pixels; the active 
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row addressing circuit 


pixel sensor wherein the sensor is a CMOS sensor; the 
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signal processing circuit 


sensor wherein each column is associated with a single 




91 


correlated double sampling unit 


subset; the sensor wherein each column is associated 
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92 


difference amplifier 


with a two subsets; the active pixel sensor further com- 
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programmable gain amplifier 


prising a correlated double sampling circuit for each 




95 


switch 


subset within the sensor; the active pixel sensor 
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switch 


wherein the pixels in the array further comprises a 




101 


reset sample circuit 


pinned photodiode within each of the pixels; and the 
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102 


signal sample circuit 


active pixel sensor wherein the sensor is a CMOS sen- 
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prior art sensor 


sor. 
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[0020] The invention has been described in detail with 
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particular reference to certain preferred embodiments 
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thereof, but it will be understood that variations and 
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output 


modifications can be effected within the spirit and scope 
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of the invention. 
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1 . An active pixel sensor comprising: 



30 
31 
32 
33 
34 
38 
41 
42 
43 
44 



signal processing circuit 
signal processing circuit 
signal processing circuit 
signal processing circuit 
row addressing circuit 
pixel array 
pixel array 
pixel array 
pixel array 
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55 



a semiconductor substrate having a two dimen- 
sional array of pixels arranged in a plurality of 
rows and columns; 

a row addressing circuit formed on the sub- 
strate; 

a column addressing circuit formed on the sub- 
strate; 

a plurality of signal processing circuits opera- 
tive^ connected to the array of pixels such that 
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each of the signal processing circuits is electri- 
cally connected to a predetermined subset of 
pixels within the array through electrically con- 
ductive signal busses, wherein each of the sub- 
sets comprises a plurality of pixels; and 
means for employing the row addressing circuit 
and the column addressing circuit to select a 
sequence of pixels having one pixel for each of 
the subsets and simultaneously transferring 
signals from each of the pixel sequences to the 
signal processing circuits. 

2. The sensor of claim 1 wherein the sensor is a color 
sensor and the each of the subsets represent a sin- 
gle color. 

3. The sensor of claim 1 wherein each column is asso- 
ciated with a single subset. 



10 

the columns has a plurality of signal busses such 
that each of the signal busses corresponds to one 
of the signal processing channels. 

5 8. The sensor of claim 6 wherein the sensor is a color 
sensor and the each of the subsets represent a sin- 
gle color. 

9. The sensor of claim 6 wherein each column is asso- 
rt dated with a plurality of the subsets and further 

comprising customization means for altering the 
association between pixels and subsets. 

10. A method for forming an active pixel sensor com- 
15 prising: 

providing a semiconductor substrate having a 
two dimensional array of pixels arranged in a 
plurality of rows and columns formed on the 
substrate, with a row addressing circuit that 
can address each of the rows, a column 
addressing circuit that can address each of the 
columns, and at least one signal processing 
circuit that is operatively connected to the array 
of pixels such that each of the signal process- 
ing circuits is electrically connected to a prede- 
termined subset of pixels within the array 
through electrically conductive signal busses, 
wherein each of the subsets comprises a plu- 
rality of pixels; and 

mirroring the two dimensional array, its associ- 
ate row and column addressing circuit, and its 
signal processing circuit to create a second x-y 
array that is the mirror image of the first x-y 
array. 



4. The active pixel sensor of claim 1 wherein the array 20 
is functionally divided into a plurality of areas, each 
of the areas having a row addressing circuit and a 
column addressing circuit. 

5. The active pixel sensor of claim 4 wherein each of 25 
the columns has a plurality of signal busses such 
that each of the signal busses corresponds to one 
of the signal processing channels. 

6. An active pixel sensor comprising: 30 

a semiconductor substrate having a two dimen- 
sional array of pixels arranged in a plurality of 
rows and columns; 

a row addressing circuit formed on the sub- 35 
strate; 

a column addressing circuit formed on the sub- 
strate; 

a plurality of signal processing circuits opera- 
tively connected to the array of pixels such that 40 
each of the signal processing circuits is electri- 
cally connected to a predetermined subset of 
pixels within the array through electrically con- 
ductive signal busses, wherein each of the sub- 
sets comprises a plurality of pixels; 45 
means for employing the row addressing circuit 
and the column addressing circuit to select a 
sequence of pixels having one pixel for each of 
the subsets and simultaneously transferring 
signals from each of the pixel sequences to the so 
signal processing circuits; and 
wherein the array is functionally divided into a 
plurality of areas, each of the areas having a 
row addressing circuit and a column address- 
ing circuit and each of the areas further being a 55 
mirror image of one of the other areas. 

7. The active pixel sensor of claim 6 wherein each of 
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